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Abstract 

The Gram-Schmidt algorithm produces a pairwise orthogonal set 
{yi}i from a linearly independent set of vectors in an inner prod- 

uct vector space V. We give a linear algorithm that constructs vectors 
{zi}i with the same span as {xj}™ and which have pairwise the same 
prescribed angle or distance, in all cases where this is possible. Finally, 
we prove an asymptotic property of {zi}^ in the infinite dimensional 
case. 
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1 Introduction. 

Let V be a real vector space with inner product x ■ y and norm ||x|| = 

k 

(x • x) 1 ' 2 , for vectors x,y in V. Any finite sum c j ' x ji f° r rea l numbers 

3=1 

Cj and vectors Xj in V, 1 < j < k, is called a linear combination of the 

vectors {xi,X2, • • • ,Xfc}. A subset E of V is called linearly independent if 

for any finite subset {xi, X2, ■ ■ ■ , x^} of E and real numbers {ci, C2, . . . , c^} 
k 

the relation Yl c j ' x j = implies that all Cj = 0, 1 < j < k. We say that E 

3=1 

is pairwise orthogonal if x ■ y = 0, for any two different vectors x and y in V. 
As is well known, any pairwise orthogonal set is also linearly independent. 
The converse implication is in general false. A pairwise orthogonal set of 
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vectors of unit length is called an ortonormal set, or an ON— set for short. 

k 

The linear span of a set E C V is the set of all linear combinations c j ' x j 

3=1 

of vectors Xj from E and is denoted by span(E). Clearly, span(E) is a linear 
subspace of V. 

We define the angle 8 between two non-zero vectors x and y in V by 
cos6 = ,, X ' V , ,, , < 6» < vr. 

IMI • llyll 

If x = or y = we define the angle 6 to be zero. In the following we 
identify tha angle 6 with its cosine p, p = cos 9 and — 1 < p < 1. The 
Gram - Schmidt Orthogonalization Algorithm produces an ortogoanal set 
of vectors from an linearly independent set. We state this result as follows, 
c.f. [3], Theorem 31, or [T|, 0. 

Theorem 1 Let E = {x{\ be a finite or denumerably infinite linearly inde- 
pendent subset ofV. Then there is a set E' = {yi} of vectors in V with the 
following properties: 

span({yi,y 2 , . . = span({x 1 ,x 2 , . . . ,£;}), f or i = 1,2, ... , (1) 

span(E') = span(E), (2) 
£/ie sei E 1 ' is an ON— set. (3) 

We are going to generalize Theorem 1 in the following way. Fix any — 1 < 
p < 1 and a linearly independent set {xi,x 2 , ■ ■ ■ , x n } in V. We construct a 
set of vectors {z\, z 2 , ■ ■ ■ , z n } that spans the same subspaces as {xi,x 2 , ... ,x n } 
and satisfies \\zi\\ = 1, z\ ■ Zj = p, for 1 < i,j < n, i / It turns out 
that a necessary and sufficient condition for such a construction is that 
p(n — 1) + 1 > in the n— dimensional case and p > in the infinite dimen- 
sional case. 

Theorem 2 Let {xi}f =1 be a linearly independent subset ofV and let —1 < 
p < 1. Then there exists a set of vectors {zj}^ =1 such that 

span({zt, z 2 ,..., Zi}) = span({x 1 ,x 2 , Xi}) (4) 

and 

\\zi\\ = 1, Zi- zj = p, (5) 
for all 1 < i,j < n, i j, if and only if ^-r < p < 1. 
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Corollary 1 Let {xj}^ =1 be a denumerably infinite and linearly independent 
set of vectors in V and let — 1 < p < 1. Then there exists a set {zi}^ =1 in 
V such that (4) and (5) hold for all 1 < i 7^ j, if and only ifO<p< 1. 

Theorem 2 and Corollary 1 can be stated in terms of distances in stead of 
angles, since if||x|| = ||y|| = l then \ \x — y\\ 2 = 2(1 — x ■ y) . 

Theorem 3 Let {xi}f =1 be a linearly independent set of vectors in V and 
< d < 2. Then there exists vectors {zj}™ =1 satisfying (4) and 

\\zi\\ = 1 and \\zi — Zj\\ = d (6) 



for 1 < i, j < n, i ^ j, if and only ifO<d< 




Corollary 2 Let {xi}^ =1 be a denumerably infinite and linearly independent 
set of vectors in V and let < d < 2. Then there exists a set {zj}^ =1 in V 
such that (4) and (6) hold for all 1 < i < j, if and only if < d < Vz. 

Remark 1. Taking d = 1 in (6) we get an equilateral set {0, z±, Z2, ■ ■ ■ , z n } 
with n + 1 points. For more on equilateral sets in normed spaces, see [3]. 

2 Proofs 

This section contains the proofs of Theorem 2 and Corollary 1 and we begin 
with the proof of Theorem 2. 

Proof of Theorem 2. Let {xi}f =l be as in the theorem, let — ^-j- < p < 1 
and perform the Gram-Schmidt algorithm on {xj}™ =1 . This gives vectors 
{?/i}?=i satisfying (1) and (3). We will define the vectors {zj}™ =1 inductively 
and start with z\ = y\. Next let w = 2/2 + 0, • z\. Then ||w|| 2 = 1 + a 2 and 
w ■ z\ = a. We take a such that w ■ z\ = p ■ \ \w\ \ , which gives a = pj \J\ — p 2 . 
Finally define Z2 = w/\\w\\. 

Now assume that we have defined Z\ , Z2, ■ ■ ■ , Zf. such that \\zi\\ = 1 and 

k 

Zi ■ Zj =p, 1 < i, j < k, i ^ j. Let w = y k+ i - J2 c j ' z j- Tnen 

i=i 

w ■ Zi = — C{ — p ■ Cj, 1 < i < k, 

and 

k 

INI 2 = i + HH^-^H 2 ' 

i=i 
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since y k +i is orthogonal to span{z\,z 2 , ■ ■ ■ ,Zk} C span{yi,y 2 , ...,yk}- This 
gives 

W ■ Zi = -Cj -p- ^Cj = p ■ \ \w\\, 

for 1 < i < k. Subtracting the last equations pairwise gives c± = c 2 = ■ ■ ■ = 
Ck = d and 

d(l +p{k- 1)) = -p- \\w\\. (7) 

Further, 

k 

\\ w \\ 2 = l + d 2 ■ || Y, z iW 2 = 1 + d 2 (k + p(k 2 - k)). (8) 
i=i 

Combining (7) and (8) gives 

d 2 ■ (1 +p(k - 1)) ■ (1 -p) ■ (l+pk)=p 2 . 

This equation can be solved for d, since p > — -^—^ > — |. Now define 
z k+i = w/HHI- Continuing in this way produces vectors {zi}f =l satisfying 
(5). It is easy to see that {zi}f =1 is linearly independet, which proves (4). 

Conversely, assume that {z±,Z2, ■ ■ ■ ,z n } are vectors in V satisfying (4) and 
(5). Then {z\, z 2 , ■ ■ ■ , z n } is linearly independent and the formula < \\z± + 
Z2 + ■ ■ ■ + z n \\ 2 = n(l +p(n — 1)) proves that p > — l/(n — 1). A 

Proof of Corollary 1. Let be as in the corollary and < p < 1. 

The proof of Theorem 2 applies and gives vectors {zi}^ with the desired 
properties. 

Conversely, assume that {z{\fl l has properties (4) and (5) for 1 < i < j. 
Then is linearly independent and < \\z\ + z 2 + • • • z n \\ 2 = "-(1 + 

p(n — 1)), n > 1. It follows that p > by letting n — > oo. A 

3 The Gram— Schmidt p— Algorithm 

In this section we describe the algorithm that produces the sequence {zj}™ =1 
in Theorem 2. Let {yi}" =1 be an ON— set in V and let — < p < 1. We 
define the vectors {^}" =1 inductively by the method in the proof of Theorem 
2. Put Z\ = yi and assume that z 2 , z 2 , ■ ■ ■ Zk have been defined. Then let 

w = a- y k+ i + (3 ■ {z\ + z 2 -\ h z k ), 
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where a and f3 satisfy 

||u,|| 2 = a 2 + /3 2 (fe + k{k - l)p) = 1 

and 

w; ■ = ft ■ (1 + (k — = p • \ \w\\, 1 < i < k. 
An easy calculation yields 

« = — ; 71 7t — and /? = - — , (9) 

l+p(fc-l) l+p(A;-l)' v ; 

which gives the following algorithm. 

The Gram-Schmidt p- Algorithm (GS P ). The input is a linearly independent 
set {x±,X2, ■ ■ ■ ,x n } in a real inner product space V. The output is a set 
{zi,Z2, • • • , £ n } of vectors with the properties (4) and (5) in Theorem 2. 

Step 0. Perform the Gram-Schmidt Algorithm in Theorem 1 and get an 
ON— set {y 1: y 2 , ■ ■ -,y n }- 

Step 1. Define z\ = y\. 

Step 2. After vectors {z\,Z2, • • • , Zk} have been constructed, we define 



(l-p)(l+pk) p . . , 

Zfc+i = V i +P (k-i) ' yk+i + i+p(k-i) ' {zi+Z2+ '- +Zk) > (10) 



Step 3. The set {z±,Z2, ■ ■ ■ ,z n } that is constructed after Step 2 has been 
performed (n — 1) times has the desired properties. A 

Formula (10) will allow us to get explicit expressions for each z^. We start 
with the following lemma. 

Lemma 1 Let {yk}± be an ON-set in V and let {zfcli be defined by (GS p ). 
Then there are numbers Zk{i), 1 < i < k and 1 < k < n, such that 

z k = z k {\)yi + z k (2)y 2 H z k (k)y k , 

where z k+ ±(i) = z k (i), for 1 < i < k — 1 and 1 < k < n — 1. 
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Proof. The case k = 2 follows from an explicit calculation. Assume that the 
lemma holds for some fixed 2 < k < n — 1 and all 1 < i < k — 1 Then for 
1 < i < k by (10) 

= i+ p (k- 1) ' (Zl W + ' ' ' + 

and 

Zfc+2(«) = 7— — r • (zi(«) H 1- z k (i) + z k+1 (i)), 

1 + pk 

from which the lemma follows. A 
We can now give explicit formulas for z k , 1 < k < n. Define 



/ x P / (l +p(m- 1)) 

1 + p(m — 1) y 1 + p(m — 2) 

m=l,2,. . . . Then we get the following result. 

Theorem 4 Let {y k }i be an ON-set in V and let {z k }i be defined by (GS P ). 
Then z\ = y\ and z k is given by 

\ _|_ p(b — l) 

Zk = ai(p)yi + a 2 (p)y 2 + ■■■ + a fe _i(p)y fc _i H a k {p)y kj (12) 

for 2 < k < n. 

Proof. The case k = 2 follows by calculation. Assume that the theorem 
holds for some 2 < k < n — 1 and consider z k +i- We note that z k +i(i), 
1 < i < k — 1, and z k+ \(k + 1) are correct by Lemma 1 and (10). Finally, 

by (10) and (11), which completes the proof of the theorem A 

4 Asymptotics. 

The final section of this paper is about the infinite dimensional case. Let 
V be the standard real vector space I 2 of points x = (x±, x 2 , ■ ■ ■ , x n , . . .) 
with finite norm ||x|| = (x\ + x\ + • • • + x\ + • • -) 1 / 2 and inner product 
x ■ y = x\y\ + x 2 y 2 + • • • + x n y n + • • • . Let be a denumerably infinite 

ON-set in V, < p < 1, and let {z^f be the vectors obtained from 
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Theorem 4 by identifying the finite dimensional space V as a subspace of I 2 
in a natural way. Then 

||z fc || = l, z k -z m =p, and \\z k - z m \\ = yj2 - 2p, (13) 

for 1 < k < m, in analogy with Theorems 2 and 3. Define a vector zq by 

zq = ai(p)yi + a 2 {p)y2 + ■■■ + a m (p)y m + .... 

It is easy to see that zq is in V and in fact that | \zq \ \ = ^Jp by a telescoping 
argument. We can now use zq to get the following asymptotic formula for 
Zk, as k — > oo. 

Theorem 5 Let 6e as above, then z k ~ zq + ^1 — p ■ y k , as k — > oo, 

in the sense that 



limsupv 7 ^ • \\z k - z - yfl-p - y k \\ < \Jp{l - p~). 



Proof. Clearly, \\z k — zq — y/1 — p ■ y k \\ is at most 

1/2 



We get 



by a telescoping series and 



B< \ py/l-p 



2 l+p(k-2) 

by an elementary calculation. The theorem follows easily. A 

Remark 2. The set {^}i° i n (13) is an infinite equilateral set in V for 
p = l/2. 

Historical remark. J0rgen Pedersen Gram, 1850 - 1916, was a danish math- 
ematician working in booth pure and applied mathematics. The german 
mathematician Erhard Schmidt, 1876 - 1959, is considered as one of the fa- 
thers of modern abstract functional analysis. The Gram-Schmidt algorithm 
was however presented before both Gram and Schmidt by the famous french 
mathematician Pierre - Simon Laplace, 1749 - 1827. 
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